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Abstract 

We examined the Direct and Indirect Effects model of Writing (DIEW), using lon- 
gitudinal data from Korean-speaking beginning writers. DIEW posits hierarchical 
structural relations among component skills (e.g., transcription skills, higher order 
cognitive skills, oral language, motivation/affect, background knowledge) where 
lower level skills are needed for higher order skills and where component skills 
make direct and indirect contributions to writing (see Fig. 1). A total of 201 Korean- 
speaking children were assessed on component skills in Grade 1, including tran- 
scription (spelling and handwriting fluency), higher order cognitive skills (inference, 
perspective taking, and monitoring), oral language (vocabulary and grammatical 
knowledge), and executive function (working memory and attention). Their writing 
skills were assessed in Grades 1 and 3. DIEW fit the data well. In Grade 1, tran- 
scription skills were directly related to writing, whereas vocabulary, grammatical 
knowledge, working memory, and attention were indirectly related to writing. For 
Grade 3 writing, inference and spelling were directly related while working memory 
made both direct and indirect contributions. Attention, vocabulary, and grammati- 
cal knowledge made indirect contributions via spelling and inference. These results 
support DIEW and its associated hypotheses such as the hierarchical nature of 
structural relations, the roles of higher order cognitive skills, and the changing rela- 
tions of component skills to writing as a function of development (a developmental 
hypothesis). 
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Introduction 


Writing is one of the most challenging skills to acquire. Nationally representative 
data from the US have consistently shown that three quarters of students write at 
or below basic proficiency (National Center for Educational Statistics, 2012). As a 
production skill, writing requires generating ideas, translating them into oral lan- 
guage, and transcribing them into written text. This is captured in the simple view of 
writing, according to which ideation (generation and translation of ideas) and tran- 
scription (encoding the translated ideas into print) are the two essential skills for 
writing development (Berninger et al., 2002; Juel, Griffith, & Gough, 1986). Moreo- 
ver, in the not-so-simple view of writing, working memory and self-regulation (e.g., 
attention, goal-setting, planning, monitoring) were further identified as component 
skills needed for coordinating multiple and iterative processes in writing (Berninger 
& Winn, 2006). These two theoretical models of developmental writing—the sim- 
ple and not-so-simple views of writing—are supported by a relatively large body 
of studies that has shown the contributions of oral language, transcription skills 
(spelling and handwriting), working memory, and monitoring to writing (Abbott & 
Berninger, 1993; Arfe, Dockrell, & De Bernardi, 2016; Babayigit, 2014; Berninger, 
Abbott, Abbott, Graham, & Richards, 2002; Berninger et al., 1997; Coker, 2006; 
Graham, Berninger, & Fan, 2007; Graham et al., 1997; Graham, Harris, & McK- 
eown, 2013; Hayes & Chenoweth, 2007; Kim et al., 2011; Kim, Al Otaiba, Folsom, 
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Fig. 1 Direct and indirect effects model of writing (DIEW) 
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Greulich, & Puranik, 2014a; Kim, Al Otaiba, Wanzek, & Gatlin, 2015a; Limpo & 
Alves, 2013; Olinghouse, 2008; Olive, 2004). 

Recently the simple and not-so-simple views of writing were integrated and 
extended by the Direct and Indirect Effects model of Writing (DIEW; see Fig. 1). 
DIEW extends the previous models in two critical ways: (a) by specifying struc- 
tural relations among component skills and (b) by expanding the component skills 
of writing to include higher order cognitive skills (e.g., reasoning, inference, per- 
spective taking), background knowledge (content and discourse knowledge), and 
affect and motivation (see below for details). DIEW has been recently examined and 
validated with English-speaking children in the US (Kim & Schatschneider, 2017). 
Our goals in the present study were to extend the prior investigation in two unique 
ways: by investigating the generalizability of DIEW in Korean, a language that is 
highly different from English, and by investigating longitudinal relations of compo- 
nent skills to writing. 


Direct and indirect effects model of writing (DIEW) 


In addition to identifying component skills, specifying structural relations or path- 
ways of relations—how component skills are related to one another and to writ- 
ing—is one of the key parts of a theoretical model. According to Singer and Rud- 
dell (1985), a theoretical model should “depict a theory’s variables, mechanisms, 
constructs, and interrelationships” (p. 620). Systematic relations among component 
skills explain mechanisms and pathways by which component skills affect writ- 
ing development and reveal not only direct effects but also indirect effects. Indirect 
effects are particularly important for lower level skills because their contributions to 
writing are expected to be primarily indirect via higher order skills and, thus, can be 
easily masked. According to DIEW (see Fig. 1), component skills have hierarchi- 
cal structural relations where foundational or low-order skills are needed for higher 
order skills, and higher order skills partially or completely mediate the relations of 
low-order skills to writing. Therefore, lower level skills have cascading effects on 
writing. Specifically, executive function (or domain-general foundational cognition), 
such as working memory, inhibitory control, and attention, supports the develop- 
ment of two large categories of skills, discourse oral language and transcription 
skills. The discourse oral language skill—the ability to produce oral texts such as 
extended conversations, stories, and informational texts—maps onto “ideation” in 
the simple view of writing (see Juel et al., 1986) and “text generation” in the not- 
so-simple view of writing (Berninger & Winn, 2006), as it captures the ability to 
generate, connect, organize, and translate ideas into oral language at the discourse 
level. Discourse oral language itself draws on multiple layers of skills, including 
foundational oral language skills (vocabulary and grammatical knowledge) and 
higher order cognitive skills (e.g., inference, perspective taking, monitoring) as well 
as executive function (e.g., working memory; Alonzo, Yeomans-Maldonado, Mur- 
phy, Bevens, & LARRC, 2016; Bianco et al., 2010; Florit, Roch, Altoe, & Loverato, 
2009; Florit, Roch, & Loverato, 2014; Kim, 2015a, 2016, 2017a; Kim & Phillips, 
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2014; Lepola, Lynch, Laakkonen, Silvén, & Niemi, 2012; Tompkins, Guo, & Jus- 
tice, 2013). 

The hypothesized hierarchical structural relations in DIEW are based on empiri- 
cal evidence. For instance, working memory (Bourdin & Fayol, 1994; Hayes & Che- 
noweth, 2007; Olive, 2004) and vocabulary and grammatical knowledge (Babayigit, 
2014; Coker, 2006; Kim et al., 2011, 2014a; Olinghouse, 2008) are related to writ- 
ing, and working memory is one of the essential skills for vocabulary and gram- 
matical acquisition (see Gathercole & Baddeley, 1990; Gathercole, Service, Hitch, 
Adams, & Martin, 1999; Kim, 2017b; Verhagen & Leseman, 2016). Given these 
relations, some of the effect of working memory on writing might be mediated by 
vocabulary and grammatical knowledge. A similar logic applies to the relations 
between working memory and other component skills in DIEW such as higher order 
cognitive skills (e.g., inference). If inference is related to writing (Kim & Schatsch- 
neider, 2017), and inference requires working memory (Craig & Lewandowsky, 
2012; Kim, 2017b), then the effect of working memory may be, at least partially, 
mediated by higher order cognitive skills. Recent studies indicated that executive 
function (or foundational cognition), foundational oral language skills, higher order 
cognitive skills, and discourse oral language skills are directly and indirectly related 
to writing (Kim et al., 2015a; Kim & Schatschneider, 2017). 

The other essential component skill, transcription (spelling and handwriting flu- 
ency), draws on knowledge or awareness of phonology, orthography, and seman- 
tics (see Adams, 1990; Berninger et al., 1992; Kim, 2011; Kim, Apel, & Al Otaiba, 
2013a; Nagy, Berninger, & Abbott, 2006; National Institute of Child Health and 
Human Development, 2000; Treiman, 1993). The extent to which transcription skills 
are developed influences the extent to which other resources (lower level domain- 
general foundational cognitive skills) are available for writing processes (see infor- 
mation processing theory in LaBerge & Samuels, 1974). Therefore, the roles of 
component skills would vary as a function of developmental phase (a developmen- 
tal hypothesis). When transcription skills are not automatized, typically during the 
beginning phase or for children with dysfluent transcription skills, children’s mental 
resources (e.g., working memory and attention) are used up to support transcription, 
and thus, transcription skills constrain employment of other component skills to a 
large extent. With further development of transcription skills, their constraining role 
would decrease, allowing these resources to be available for higher order processes. 

The component skills and overall structural relations hypothesized in DIEW are 
expected to be language general. In other words, the broad framework of DIEW 
are not expected to differ across languages or writing systems because writing like 
language (Bock, 1982) and reading (Radach, Kennedy, & Rayner, 2004) relies on 
universal human information processing. However, this does not deny language- 
or orthography-specific processes found in many prior studies (e.g., Aro & Wim- 
mer, 2003; Dromi & Berman, 1986; Naigles & Leher, 2002; McBride-Chang et al., 
2010). In fact, as a corollary of the developmental hypothesis of DIEW, the relative 
contributions of component skills at different developmental phases might vary as a 
function of orthographic depth: The constraining role of transcription skills would 
not last as long in transparent orthographies as they would in opaque orthogra- 
phies (see, for example, Babayigit & Stainthorp, 2010) because, when taught well, 


va Springer 


Unpacking pathways using the direct and indirect effects model... 1323 


children acquire transcription skills earlier in transparent orthographies than in 
opaque orthographies. 

Writing, of course, requires generating ideas and therefore, draws on background 
knowledge, which includes both content and discourse knowledge (e.g., Beaufort, 
2004; Hayes, 2006; McCutchen, 1986; Olinghouse, Graham, & Gillespie, 2015; 
Perin, Keselman, & Monopoli, 2003; Scardamalia & Bereiter, 1985). The impor- 
tance of content knowledge has been highlighted in the knowledge-telling model 
according to which novice writers resort to telling what they know (Scardamalia & 
Bereiter, 1985). Discourse knowledge includes knowledge about characteristics of 
different genres (e.g., text structure and associated key words) and about procedures 
and strategies to present content appropriate for the genre (e.g., narrative, compare- 
contrast; Olinghouse et al., 2015). In DIEW, background knowledge is expected to 
have a reciprocal relation with the development of writing and discourse oral lan- 
guage skills. 

Furthermore, in DIEW, one’s affect and motivation, including one’s attitudes 
and beliefs toward and positive and negative emotions (e.g., anxiety) and thoughts 
associated with writing, are expected to develop interactively with children’s tran- 
scription and written composition skills. Literature on motivation has shown that 
students’ beliefs about their ability to perform a task and values about the impor- 
tance of the task influence students’ achievement in complex tasks such as writing 
via their effort and persistence (Eccles, 2005; Eccles & Wigfield, 2002; Graham 
et al., 2007; Klassen, 2002; Pajares, 2003). In DIEW, the relation between writing 
and affect is hypothesized to be reciprocal, such that students’ development and dif- 
ficulties with writing (transcription and written composition) would influence their 
affect and motivation, which, in turn, would influence further development of writ- 
ing skills. 

Another distinguishing feature of DIEW is inclusion of higher order cogni- 
tive skills as component skills. Quality writing requires “organizing and thinking 
through ... ideas or experiences and ... explicating the relationships among them” 
(Applebee, 1984, p. 577). Therefore, quality writing would draw on one’s analyti- 
cal and reasoning skills such as inference. Perspective taking, one’s knowledge of 
and inferences about others’ mental and emotional states, also would be important 
to writing. Perspective taking in relation to writing has been studied with a specific 
focus on audience awareness (e.g., Carvalho, 2002; Elbow, 1981; Ryder, Vander Lei, 
& Roen, 1999) because quality writing requires an understanding of the needs of 
the readers and modulating language and structure accordingly (Kim & Schatsch- 
neider, 2017) in order to engage their readers (Wollman-Bonilla, 2001). In DIEW, 
perspective taking instead of audience awareness is included because it is a broader 
concept that encompasses audience awareness and reflects the idea that the role of 
perspective taking in writing goes beyond an understanding of audience. For exam- 
ple, source-based writing or read-to-write tasks are widely used in daily instruction 
(Graham & Harris, 2017) as well as state and national assessments (e.g., National 
Assessment of Educational Progress [NAEP)]). In this case, quality writing depends 
on the writer’s accurate understanding of the source text (i.e., reading skills; Kim, 
in press), which requires an understanding of the source material author’s perspec- 
tive and motivation (i.e., perspective taking) as well as perspectives of characters in 
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the source material (Kim, 2015a, 2017a; Kim & Phillips, 2014). It should be noted 
that audience awareness has been studied with older children and adults, assuming 
that it is a late-developing skill, and is generally accepted as being relevant to writ- 
ing after a certain point of development (e.g., Grade 5; Carvalho, 2002). However, 
even young children demonstrate perspective taking in oral language interactions 
(e.g., De Temple, Wu, & Snow, 1991; Kim, 2015a, 2015b, 2017a; Kim & Phillips, 
2014; also see a large body of literature on theory of mind) and audience aware- 
ness in writing (Wollman-Bonilla, 2001). Overall, despite speculations (Applebee, 
1984; McCutchen, 2000), reasoning (e.g., inference) and perspective taking have not 
been explicitly included as component skills in previous theoretical models of devel- 
opmental writing. The other higher order cognitive skill, monitoring, on the other 
hand, has garnered attention for developing writers (e.g., Limpo & Alves, 2013) and 
is included in the not-so-simple view of writing as part of the self-regulation con- 
struct (Berninger & Winn, 2006). Per the developmental hypothesis noted above, 
higher order cognitive skills are expected to play increasingly greater roles in writ- 
ing as children develop their literacy skills for a couple of reasons: (a) the constrain- 
ing role of transcription skills decreases, allowing higher order cognitive skills to be 
available for writing processes, and (b) the complexity of texts children are expected 
to produce increases as children develop literacy skills (i.e., in upper grades), plac- 
ing greater demands on language and higher order cognitive skills. 

The structural relations hypothesized in DIEW have been recently investigated 
with English-speaking children. Results showed that DIEW fit the data very well, 
and lower level skills were found to make indirect contributions to writing via upper 
level skills (Kim & Schatschneider, 2017). Furthermore, a higher order cognitive 
skill, inference, was independently related to writing quality after accounting for 
transcription skills and perspective taking (Kim & Schatschneider, 2017). 


Present study 


Our primary goals were twofold: (a) to examine the generalizability of DIEW (the 
overall hierarchical structural relations and associated direct and indirect effects) in 
a language other than English, and (b) to test the developmental hypothesis (i.e., 
changing contributions of component skills over time), using longitudinal data from 
Korean-speaking children in Grades 1| and 3. Korean is vastly different from English 
in the oral language and writing system. Unlike English, the Korean language has 
a predicate-final structure (i.e., subject-object-verb) and rich morphology due to its 
agglutinative nature (i.e., a high rate of affixes and inflections). The writing system 
of the Korean language, Hangul, is also distinct from English as it is fairly transpar- 
ent (Cho, 2009; Kim, 2011). As noted above, the overall structural relations hypoth- 
esized in DIEW are not expected to differ across languages and writing systems. 
Note, however, that an examination of the hypothesis about cross-language variation 
was beyond the scope of the present study because it requires cross-linguistic longi- 
tudinal studies. 

The present study also extends the earlier study of DIEW with English-speak- 
ing children by using longitudinal data to investigate potentially changing roles of 
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component skills as children develop literacy skills over time (see the developmental 
hypothesis above). As noted above, component skills are expected to have differen- 
tial relations to writing outcomes as a function of development such that transcrip- 
tion skills are expected to have greater influences on writing in the beginning phase 
of writing development, whereas other skills such as higher order cognitive skills 
are expected to have greater influences at a more advanced phase. 

Specific research questions that guided the present study were as follows: 


1. Does DIEW fit the data from Korean-speaking children well? 

2. What is the nature of concurrent relations of component skills to writing in Grade 
1? 

3. What are longitudinal relations of component skills in Grade 1 to writing in Grade 
3? 

4. Are higher order cognitive skills (inference, perspective taking, and monitor- 
ing) in Grade | related to writing skills in Grades 1 and 3 after accounting for 
transcription skills, foundational oral language skills, and foundational cognitive 
skills? 


We hypothesized that DIEW would fit the data from Korean-speaking children 
well. Higher order cognitive skills, inference in particular, were hypothesized to be 
related to writing, given recent evidence from English-speaking first graders (Kim & 
Schatschneider, 2017). Finally, we expected that the relative contributions of com- 
ponent skills might differ for writing in Grade 1 versus Grade 3 such that transcrip- 
tion skills would play greater roles in Grade 1 writing, whereas higher order cogni- 
tive skills would play larger roles in Grade 3 writing. 


Method 
Participants 


A total of 201 children (56% boys; mean age=6.84 years, SD=.30) in Grade | 
participated in a larger longitudinal study of Korean literacy development wherein 
a cohort of children was followed from Grade 1 to Grade 3. Results on oral lan- 
guage skills in Grade 1 were reported earlier (Kim, 2016). Participating children 
were from seven classrooms in a single public elementary school in an urban area in 
South Korea. In Grade 3, 168 students remained, with attrition (16%) largely due to 
transfer to other schools. However, those who remained in the study and those who 
dropped out did not differ in the skills measured in Grade 1 after accounting for age, 
Wilks’s Lambda=.96, F(13, 147)=.50, p=.92. The school personnel and neighbor- 
hood indicated that the children were largely from middle-class or low-middle-class 
families although socioeconomic backgrounds of the individual children were not 
available. None of the participating children had identified disabilities. 

Formal education in South Korea starts in Grade 1. However, the vast majority 
of children attend kindergarten (either private or public) and receive some form of 
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literacy instruction. Therefore, many children have foundational literacy skills (Cho, 
2009; Cho, McBride-Chang, & Park, 2008; Kim, 2011, 2015b; Kim, Park, & Wag- 
ner, 2014b) and writing skills (Kim, Park, & Park, 2013b, 2015b) at entry to Grade 
1. Curriculum in elementary schools (Grades 1-6) is centralized and uniform. Read- 
ing and writing are part of the language arts curriculum and are integrated particu- 
larly in primary grades such that writing instruction mostly focuses on expressing 
ideas (by short answer or short essay) in response to a written passage. 


Measures 


Children were assessed on the following constructs in Grade 1: working memory, 
attention, vocabulary, grammatical knowledge, inference, perspective taking (the- 
ory of mind), comprehension monitoring, spelling, handwriting fluency, and writ- 
ing. Writing was assessed in Grade 3 again, using the same task used in Grade 1. 
All constructs were assessed by single tasks, except for handwriting fluency, which 
was assessed by two tasks. All the tasks were piloted and revised prior to the pre- 
sent study. Unless otherwise noted, children’s responses were scored dichotomously 
(1=correct; O=incorrect) for each item and all the items were administered to 
children. 


Working memory 


A widely used working memory task, the listening span task (Kim, 2015a, 2015b; 
Daneman & Merikle, 1996), was used. In this task, the child was presented with a 
short sentence involving common knowledge to children (e.g., Birds can fly) and 
was asked to identify whether the heard sentence was correct or not (yes/no). After 
hearing two or three sentences, the child was asked to identify the first words in 
the sentences. The listening span task in English and European languages requires 
children to identify the last words in each sentence (e.g., Kim, 2017a, 2017b; Florit 
et al., 2009). However, in this study the child was asked to identify the first word in 
each sentence because final words in Korean sentences are either verbs or adjectives 
that inflect so that endings are highly similar (i.e., similar syllables). This version of 
the task was used in previous studies with Korean-speaking children and was shown 
to relate to vocabulary and grammatical knowledge (Kim, 2015a). There were four 
practice items and 18 experimental items, and administration was discontinued after 
three consecutive incorrect responses. Children’s responses regarding the veracity of 
the statements were not scored, but their responses on the first words in correct order 
were given a score of 0 to 2: 2 for correctly identifying all the first words in correct 
order; | for identifying the correct first words, but in incorrect order; and 0 for iden- 
tifying incorrect first words. Cronbach’s alpha was .80. 


Attention 


Attention was measured by an adapted version of the first nine items of the Strengths 
and Weaknesses of ADHD Symptoms and Normal Behavior Scale (SWAN; 
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Swanson et al., 2006). The full version of the SWAN includes 30 items, but only the 
first nine items are related to sustaining attention on tasks (e.g., “‘Engage in tasks 
that require sustained mental effort’; Saez, Folsom, Al Otaiba, & Schatschneider, 
2012), whereas the other items assess hyperactivity (nine items) and aggression (12 
items). SWAN is a behavioral checklist typically rated by classroom teachers with 
each item rated on a 7-point scale from 1 (far below average) to 7 (far above aver- 
age). SWAN was completed by the students’ classroom teachers. Cronbach’s alpha 
was .99. 


Vocabulary 


A normed expressive vocabulary task was used (Kim at al., in press). This task was 
developed, designed, and normed with Korean-speaking children and was not a 
translation of an assessment in another language. In this task, the child was asked 
to identify pictured objects with increasing difficulty (e.g., the child was shown an 
illustration of a whale and was asked to name it). There were four practice items 
and 52 test items. Testing discontinued after five consecutive incorrect items. Cron- 
bach’s alpha was .89. 


Grammatical knowledge 


Children’s grammatical knowledge was assessed by an adapted task from a previous 
study (Kim, 2015a). The child’s task was to detect and correct grammatical errors 
in grammatical markers, tense, and postpositions. The child was asked whether a 
heard sentence was grammatically correct. If grammatically incorrect, the child was 
asked to correct the sentence. The child received a point for accurately responding to 
the correctness of the sentence, and earned a point for each successfully correcting 
grammatical error in incorrect sentences. There were two practice items and 18 test 
items. Cronbach’s alpha was .84. 


Knowledge-based inference 


A knowledge-based inference task was developed modeling after the Inference sub- 
test of the Comprehensive Assessment of Spoken Language (CASL; Carrow-Wool- 
folk, 1999). In this task, the child heard two- to three-sentence scenarios and was 
asked a question that required inference based on background knowledge. An exam- 
ple item is “Soomin wanted to wear last year’s dress to school one day, but when she 
tried it on, she could not wear it. Why?” Correct responses included answers such as 
“She has outgrown the dress,” or “The dress is too small for her”. There were two 
practice items and 12 test items. Cronbach’s alpha was .69. 


Perspective taking 
Perspective taking was measured by theory of mind scenarios. Theory of mind is 


typically defined as one’s knowledge of the mental status and perspectives of oth- 
ers (e.g., thoughts and emotions; Howlin, Baron-Cohen, & Hadwin, 1999), and is 
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widely assessed by false belief and appearance-reality tasks. Although theory of 
mind has been typically studied with young children (e.g., prekindergarten-aged), 
recent studies have revealed its development into early adulthood (Valle, Massaro, 
Castelli, & Marchetti, 2015). Theory of mind develops from first-order understand- 
ing (e.g., knowledge of a story character’s mistaken belief), followed by second- 
order understanding (e.g., knowledge of a character’s mistaken belief about another 
character; Astington & Jenkins, 1999; Caillies & Sourn-Bissaoui, 2008; Kim, 2015a, 
2017a; Norbury, 2005). 

In the present study, perspective taking was measured using first-order and sec- 
ond-order theory of mind scenarios appropriate to the developmental stage of the 
children. The first-order questions were based on an appearance-reality scenario 
using a snack box that is highly familiar to children in Korea (Gwon & Lee, 2012). 
The second-order theory of mind questions were based on false belief scenarios 
involving the context of a bakery and a visit to a farm (Kim, 2015a; Kim & Phillips 
2014). For the scenarios, children listened to a series of events presented with illus- 
trations, then answered the assessor’s questions requiring inference about a char- 
acter’s belief (first order) or a character’s belief about another character’s thoughts 
(second order). The perspective taking measure included 15 questions (three first- 
order questions and 12 s-order questions). Cronbach’s alpha was .74. 


Comprehension monitoring 


Following many previous studies on comprehension monitoring, an inconsistency 
detection task was used (e.g., Baker, 1984; Kim & Phillips, 2014). The child heard 
a short story (e.g., “Jimin’s favorite color is green. His bag is green. His pants are 
green. Jimin’s favorite color is red.”) and was asked to identify whether the story 
made sense or not. The meaning of “not making sense” was explained in practice 
items as sentences not going together. If the child indicated that the story did not 
make sense, he or she was asked to provide a brief explanation and to fix the story so 
that it made sense. There were four practice items and 14 test items. Consistent sto- 
ries (six items) and inconsistent stories (eight items) were randomly ordered. For the 
inconsistent stories, in addition to the accuracy of the child’s response, the accuracy 
of the child’s explanation was dichotomously scored, resulting in a total possible 
score of 22. Cronbach’s alpha was .78. 


Spelling 


Spelling was assessed by a 30-item dictation task (Kim & Petscher, 2013). The task 
was developed in consultation with primary grade educators and included ortho- 
graphically transparent words and those that undergo phonological shifts (see Kim 
& Petscher, 2013, for the list). For each item, children were read aloud (a) the target 
word in isolation, (b) the target word in a sentence, and (c) the target word in isola- 
tion again. Cronbach’s alpha was .92. 
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Handwriting fluency 


Students’ handwriting fluency is typically assessed by letter-writing, sentence-writ- 
ing, or paragraph-writing tasks (e.g., Kim et al. 2013b, 2015b). In the present study, 
we used two paragraph-copying tasks (110 words in the first task; 194 words in 
the second task), which were administered approximately one week apart. In these 
tasks, students were given a passage and were asked to copy as much of it as pos- 
sible in a minute. The number of words written correctly was their score. Inter-rater 
reliability (exact agreement) using 50 samples was .98. 


Writing 


A previously used experimental task was used to assess students’ writing skills. In 
this task, the student was asked to write about an animal that would be best suited 
as a class pet and to provide reasons (Kim et al., 2015a; Wagner et al., 2011). Stu- 
dents’ written compositions were evaluated for overall quality focusing on the 
extent to which ideas were developed and organized. The rating scale ranged from 
0 (unscorable due to no writing or illegible handwriting) to 5 (a clear main idea 
is elaborated in an organized manner). A similar approach has been used widely 
in previous studies (e.g., Graham, Harris, & Chorzempa, 2002; Kim et al., 2014a, 
2015a; Olinghouse, 2008). Inter-rater reliability (exact agreement) using 50 writing 
samples each in Grades 1 and 3 (for a total of 100 written samples) ranged from 84 
to 100%, respectively. 


Procedures 


For the majority of the tasks, children were individually assessed by rigorously 
trained research assistants in a quiet space in the school. Writing and spelling tasks 
were administered as a whole class. The two tasks of handwriting fluency skills were 
administered on separate days approximately a week apart. The individual assess- 
ment battery was administered in several sessions over a period of a month with 
each session 30 to 40 min long. Data were collected approximately three months 
after the academic year had started. 


Data analysis strategy 


Primary data analytic strategies were Confirmatory Factory Analysis (CFA) and 
Structural Equation Modeling (SEM), using MPLUS 7.1 (Muthén & Muthén, 
2013). A latent variable was created for handwriting fluency. The other con- 
structs were assessed by single measures, and therefore, observed variables were 
used. The research questions about whether DIEW fits the data from Korean- 
speaking children well and about concurrent relations (Research Questions 1 
and 2) were addressed by fitting and comparing three alternative models shown 
in Fig. 2 using data from Grade 1. In Fig. 2a, higher order cognitive skills and 
transcription skills were hypothesized to completely mediate the contributions 
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Gl 
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Fig. 2 Three alternative models of relations among Grade | writing, inference, theory of mind, compre- 
hension monitoring, spelling, handwriting fluency, vocabulary, grammatical knowledge, working mem- 
ory, and attention. Gl1=Grade 1; ToM=theory of mind; Monitor=comprehension monitoring; Hand- 
write = handwriting fluency; Grammar = grammatical knowledge 


of vocabulary, grammatical knowledge, working memory, and attention to writ- 
ing. In Fig. 2b, direct contributions of vocabulary and grammatical knowledge 
to writing were examined. In Fig. 2c, working memory and attention were 
hypothesized to make direct contributions over and above all the other variables 
to writing. For the longitudinal relations question (Research Question 3), a simi- 
lar set of alternative models were fitted in which direct contributions to Grade 3 
writing of Grade 1 component skills, in addition to Grade 1 writing, were sys- 
tematically examined (see Fig. 3a—c). These models (Figs. 2, 3) also addressed 
the last research question about the relations of higher order cognitive skills to 
writing (Research Question 4). Across all the models, vocabulary and grammati- 
cal knowledge were hypothesized to predict transcription skills, based on the 
importance of semantic knowledge to spelling (see Treiman, 1993) and prior 
evidence (Kim et al., 2013a). In addition, based on preliminary analysis, work- 
ing memory was allowed to directly relate to higher order cognitive skills, but 
not to transcription skills, and attention was allowed to directly relate to tran- 
scription skills, but not to higher order cognitive skills (see Figs. 2, 3). 
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Fig.3 Three alternative models of relations among Grade 3 writing and Grade 1 writing, inference, 
theory of mind, comprehension monitoring, spelling, handwriting fluency, vocabulary, grammatical 
knowledge, working memory, and attention. Gl =Grade 1; G3 =Grade 3; ToM=theory of mind; Moni- 
tor=comprehension monitoring; Handwrite = handwriting fluency; Grammar = grammatical knowledge 


Model fit was evaluated by the Chi square statistic, comparative fit index 
(CFI), Tucker-Lewis index (TLD, root mean square error of approximation 
(RMSEA), and standardized root mean square residuals (SRMR). Typically, 
CFI and TLI values equal to or greater than .90 and RMSEA and SRMR values 
equal to or less than .08 are considered to be acceptable (Hu & Bentler, 1999; 
Kline, 2005). Model comparisons for nested models were made using Chi square 
differences. 


Results 

Descriptive statistics and preliminary analysis 

Table | shows descriptive statistics. Mean scores in writing were somewhat low 
in Grade 1 (1.86) and Grade 3 (2.69), but there was sufficient variation around the 
means. Mean performance on the normed vocabulary task in Grade 1 ranked in 


the 35" percentile. Distributional properties of all the variables were appropri- 
ate as indicated by skewness and kurtosis values, which were within+3 for all 
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Table 1 Descriptive statistics 


Variable M SD Min Max Skewness Kurtosis 
G1 Working memory 12.97 6.65 0 28 — 0.46 — 0.33 
G1 Attention 44.63 14.21 9 63 =32, — 1.03 
G1 Vocabulary 30.56 TAL 2 47 —0.72 0.95 
G1 Grammar 10.20 5.07 0 25 0.42 -0.14 
G1 Inference 7.20 2.66 0 12 —0.57 —0.20 
G1 Theory of mind 5.24 2.91 0 14 0.64 0.20 
G1 Monitoring 15.81 3.83 0 22 —0.95 1.52 
G1 Spelling 13.71 6.72 0 29 -0.41 -0.57 
G1 Handwriting | 15.78 7.66 0 46 0.67 1.64 
G1 Handwriting 2 19.36 7.57 0 60 0.90 4.28 
G1 Writing 1.86 0.69 0 4 0.19 2.86 
G3 Writing 2.69 1.02 0 5 -0.22 0.29 


G1 = Grade 1; Grammar = grammatical knowledge; Handwriting = handwriting fluency (1 or 2=task 1 
or 2); G3, = Grade 3 


Table 2 Correlations between variables 


1.G1 Working memory — 

2. G1 Attention 13+ = 

3. G1 Vocabulary 44 26 - 

4. G1 Grammar 42 24 AL = 

5. G1 Inference 43 24 56 44 - 

6. G1 Theory of mind 35 12+ 33 34 AT - 

7. G1 Monitoring 43 24 AS 37 52 44 - 

8. GI Spelling 28 36 50 27 45 23 30 - 

9. G1 Handwriting 1 31 29 35 .32, 36 21 21 AT - 

10. G1 Handwriting 2 29 32 36 8.34 33 140° .22 49 70 - 

11. G1 Writing 21 22. 330 17 24 14 160 «6440 3889 
12. G3 Writing 37 34 35 22 42 15 26 52 33 641 28 


All coefficients are statistically significant at p<.05 unless marked by “*” 


G1 =Grade 1; Grammar= grammatical knowledge; Handwriting = handwriting fluency (1 or 2=task | or 
2); G3 =Grade 3 


variables except one: Kurtosis of the second handwriting fluency task was 4.28. 
Therefore, raw scores were used in the subsequent analyses. 

Bivariate correlations between measures are presented in Table 2. Working 
memory, attention, vocabulary, grammatical knowledge, and higher order cog- 
nitive skills were weakly to moderately related to Grade 1 and Grade 3 writing 
quality (.14<rs<.42). Transcription skills were moderately related to Grade 1 
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and Grade 3 writing quality (.33<rs<.52). Grade 1 writing quality was weakly 
related to Grade 3 writing quality (r=.28). Language and cognitive skills were 
weakly to moderately related to each other (.12 <rs <.56). Because children were 
nested within teachers, intraclass correlations due to classroom differences were 
estimated using the equation ICC=(level 2 variance)/(level 1 variance + level 
2 variance). ICCs for the vast majority of measures were zero (e.g., grammati- 
cal knowledge, inference) or minimal (e.g., .013 for vocabulary, .016 for writing 
quality). The only exception was attention, for which the ICC was .27. 


Concurrent relations of component skills to writing quality in grade 1 


The three alternative models shown in Fig. 2 were fitted to the data. For the hand- 
writing fluency latent variable, the loadings were strong (ps < .001; see Fig. 4). The 
first model, Fig. 2a, hypothesized that transcription and higher order cognitive skills 
are directly related to writing quality, whereas foundational cognitive skills and oral 
language skills are indirectly related to writing. This model had an excellent fit to the 
data, y” (17) = 18.56, p=.35, CFI= 1.00, TLI= 1.00, RMSEA = .02, SRMR =.03. In 
Fig. 2b, vocabulary and grammatical knowledge were hypothesized to be directly 
related to writing quality in Grade 1 over and above higher order cognitive skills and 
transcription skills. The model fit was also good, x? (15) = 15.73, p=.40, CFI=1.00, 
TLI= 1.00, RMSEA =.02, SRMR=.03. In Fig. 2c, working memory and attention 
were hypothesized to directly relate to writing quality in Grade 1 over and above all 


Writing 


era 


-,02 
"704 P02 


ae 29 720 


| 
Monitor 


Inference 


13 


Fig.4 Standardized path coefficients for the final model for Grade 1 writing. Statistically significant 
paths (p<.05) are indicated by solid lines; nonsignificant paths are indicated by dashed lines. G1 = Grade 
1; ToM=theory of mind; Monitor=comprehension monitoring; Handwrite=handwriting fluency; 
Grammar = grammatical knowledge 
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the other language, cognitive, and transcription skills, and the model fit was also 
good, 7 (15)= 15.96, p=.38, CFI=1.00, TLI= 1.00, RMSEA =.02, SRMR=.03. 
Chi square difference tests showed that Fig. 2a was not different from Fig. 2b, 
Ay’ =2.83, Adf=2, p=.24, or Fig. 2c, Ay’=2.6, Adf=2, p=.27. Figure 2b and c 
are not nested models, and therefore, their model fits cannot be compared using the 
Chi square difference test. Inspection of the path coefficients showed that the direct 
focal paths in Fig. 2b (vocabulary and grammatical knowledge) and Fig. 2c (work- 
ing memory and attention) were not statistically significant. Therefore, Fig. 2a was 
chosen as the final model for parsimony. In other words, vocabulary, grammatical 
knowledge, working memory, and attention were not directly related to writing qual- 
ity over and above higher order cognitive skills and transcription skills. 

Standardized path coefficients of the final model for Grade | are shown in Fig. 4. 
None of the higher order cognitive skills were independently related to writing 
(ps>.63) after accounting for transcription skills. Spelling (8=.25, p=.002) and 
handwriting fluency (B=.32, p<.001) were both independently related to writing 
quality. Vocabulary was weakly to moderately related to all the higher order cogni- 
tive skills and transcription skills (.17<Bs <.43, ps <.02). Grammatical knowledge 
was also weakly but significantly related to them (.15<PBs<.22, ps<.03) with an 
exception for spelling (8=.04, p=.56). Working memory was moderately related 
to vocabulary and grammatical knowledge (.40 <ys <.42, ps<.01) and weakly but 
directly related to higher order cognitive skills (.14<ys<.24, ps<.02). Attention 
was weakly related to vocabulary, grammatical knowledge, spelling, and handwrit- 
ing fluency (.19<ys<.23, ps <.002). In addition to the direct effects of transcrip- 
tion skills on writing quality, indirect effects of working memory, attention, vocab- 
ulary, and grammatical knowledge via transcription skills were as follows: .08 for 
grammatical knowledge, .12 for working memory, .19 for attention, and .20 for 
vocabulary. 


Longitudinal relations of component skills to writing quality 


In order to examine the relations of component skills in Grade 1 to writing qual- 
ity in Grade 3, the three alternative models shown in Fig. 3 were fitted to the data. 
Model fit was excellent for Fig. 3a, Via (22) =30.58, p=.10, CFI=.99, TLI=.97, 
RMSEA =.04, SRMR=.04; for Fig. 3b, y” (20)=30.39, p=.06, CFI=.99, 
TLI=.96, RMSEA=.05, SRMR=.04; and for Fig. 3c, y” (20)=22.35, p=.32, 
CFI= 1.00, TLI=.99, RMSEA=.02, SRMR=.03. Chi square difference tests 
revealed that Fig. 3c is superior to both Fig. 3a, Ay7=8.23, Adf=2, p=.02, and 
Fig. 3b, Ay?=8.04, Adf=2, p=.02. Therefore, Fig. 3c was chosen as the final 
model. 

Standardized path coefficients are presented in Fig. 5. Inference (B =.22, p=.007) 
and spelling (8=.32, p<.001) were independently related to writing quality in 
Grade 3. Working memory in Grade 1 was also directly related to writing quality 
in Grade 3 (y=.19, p=.008) as well as indirectly related via oral language skills, 
inference, and spelling. Theory of mind and comprehension monitoring were not 
independently related to Grade 3 writing (ps>.20). Handwriting fluency was not 
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Fig.5 Standardized path coefficients for the final model for Grade 3 writing. Statistically significant 
paths (p<.05) are indicated by solid lines; nonsignificant paths are indicated by dashed lines. G1 = Grade 
1; G3=Grade 3; ToM=theory of mind; Monitor=comprehension monitoring; Handwrite = handwriting 
fluency; Grammar = grammatical knowledge 


independently related to Grade 3 writing quality (B=.11, p=.25) after accounting 
for its contribution to Grade | writing. Grade 1 writing was also not independently 
related to Grade 3 writing quality (B=-.03, p=.71) after accounting for the con- 
tributions of Grade 1 component skills. The relations of attention, vocabulary, and 
grammatical knowledge to higher order cognitive skills and transcription skills were 
similar to those in Grade 1. The total effect of working memory on Grade 3 writ- 
ing was .30 (.19 direct effect+.11 indirect effect). The indirect effects of variables 
on Grade 3 writing quality were as follows: .05 for grammatical knowledge, .11 for 
working memory, and .22 for vocabulary, and .27 for attention, 


Discussion 


DIEW extends previous theoretical models of developmental writing by specifying 
structural relations among component skills as well as incorporating higher order 
cognitive skills, background knowledge, and motivation and affect as component 
skills. The present study replicates and extends a previous investigation of DIEW 
with English-speaking children (Kim & Schatschneider, 2017) in two ways: The 
present study (a) used data from children who speak and learn to write in a lan- 
guage that is highly different from English (i.e., Korean) and (b) investigated differ- 
ential relations of component skills as a function of development (the developmental 
hypothesis) using longitudinal data. Specifically, our foci in the present study were 
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to examine DIEW and longitudinal and differential relations of component skills, 
including higher order cognitive skills, to later writing, using data from Korean- 
speaking children. 


Generalizability of DIEW to Korean-speaking children 


Overall, DIEW fit the data well for Korean-speaking children, supporting the gen- 
eralizability of DIEW to Korean. The component skills were related to writing in 
Grades | and 3 as shown in the bivariate correlations, with magnitudes ranging from 
.14 to .52 (Table 2). The roles of component skills in writing were also supported 
by the finding that Grade 1 writing was no longer related to G3 writing once the 
contributions of components skills in Grade 1 were accounted for (see Fig. 5; see 
also Kent, Wanzek, Petscher, Al Otaiba, & Kim, 2014, for similar results). How- 
ever, whereas some component skills were directly related, others such as attention, 
vocabulary, and grammatical knowledge were indirectly related to writing. Indirect 
effects as measured by standardized path coefficients were not minimal, particularly 
for attention (.19 to .27) and vocabulary (.20 to .22). The contributions of vocab- 
ulary and grammatical knowledge to writing are convergent with previous studies 
(Kim et al., 2011, 2015a; Olinghouse, 2008), but also divergent in that their effects 
were indirect, whereas previous studies showed direct (or unique) relations. The dis- 
crepancy in terms of direct and indirect relations is likely attributed to differences in 
study design. For example, in the present study, higher order cognitive skills were 
accounted for, whereas they were not in previous investigations. 

The present findings also underscore the contribution of attention to writing. 
Attention or attentional control is included in the not-so-simple view of writing as 
part of the self-regulation construct (see Berninger & Winn, 2006) and in DIEW 
as part of executive function. However, only a few studies have empirically investi- 
gated its role in writing. Hooper and his colleagues (2011) found that an executive 
function latent variable that included attention and working memory was related to 
writing after accounting for fine motor skill, word reading, and rapid automatized 
naming. Kent and his colleagues (2014) also showed that attention in kindergar- 
ten predicted writing quality in Grade | for English-speaking children. The present 
study extended these previous studies by showing the multiple pathways by which 
attention is indirectly related to writing (i.e., via vocabulary, grammatical knowl- 
edge, and transcription skills). Taken together, these studies demonstrate the signifi- 
cant role of attention in writing skills. 


Longitudinal relations: developmental hypothesis 


The present findings highlight the differential roles of component skills as a function 
of development. In Grade 1, only transcription skills were directly related to writing, 
and the other component skills were not directly related to writing after account- 
ing for their contributions via transcription skills. For Grade 3 writing, inference 
and spelling (but not handwriting fluency) had direct relations to writing; working 
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memory had both a direct relation to writing and indirect relation to writing via 
other skills (vocabulary, inference, and spelling). While these results support the 
well-established role of transcription skills for developing writers (e.g., Abbott & 
Berninger, 1993; Graham et al., 1997; Kim et al., 2011, 2015a; Kim & Schatschnei- 
der, 2017), we believe that the different pattern of results in Grades 1 and 3 suggests 
the developmental nature of relations. During the very beginning phase of writing 
development in Grade 1, transcription skills play a large constraining role, creating a 
bottleneck phenomenon, to the extent that the roles of the other component skills are 
muted: Transcription skills completely mediated the relation of working memory to 
writing in Grade |. In Grade 3, however, the constraining role of transcription skills 
is reduced (e.g., the relation of handwriting fluency to Grade 3 writing was .11, but 
to Grade 1 writing was .32), allowing the contributions of lower order domain-gen- 
eral cognition, working memory, and higher order cognitive skills such as inference 
to writing. Indeed, the total effect of working memory on writing increased from .12 
for Grade | writing to .30 for Grade 3 writing, primarily due to working memory’s 
direct relation to writing in Grade 3. 

The independent relation of inference to writing even for beginning writers is 
worth noting. Although speculations have been made about the roles of reasoning 
and perspective taking in developmental writing (Applebee, 1984; McCutchen, 
2000), these have not been investigated for beginning writers until recently. The pre- 
sent findings are convergent with a study with English-speaking children in Grade 
1 (Kim & Schatschneider, 2017) but also divergent from it because in the present 
study, the relation of inference to writing was found for Grade 3 writing, but not 
for Grade 1 writing. We speculate that the direct relation of inference to writing in 
Grade 3 but not in Grade | can be explained by the developmental hypothesis noted 
above. The fact that Grade 1 inference is independently related to Grade 3 writing, 
but not Grade | writing, indicates that although the importance of children’s higher 
order cognitive skills in writing skills may not be readily apparent at a particular 
point of development (e.g., in Grade 1), this does not negate the importance of these 
skills in writing development. It is unclear, however, why inference was related to 
writing in Grade | for English-speaking children, but not for the present sample of 
Korean-speaking children in Grade 1. A future cross-linguistic study is needed. 

The other higher order cognitive skills, perspective taking and monitoring, were 
not independently related to writing after accounting for the other variables in the 
model. Although these findings are similar to recent findings with English-speaking 
first graders (Kim & Schatschneider, 2017), they also contrast with previous evi- 
dence on the unique contribution of monitoring to writing. Limpo and Alves (2013) 
operationalized monitoring via detection and correction of inconsistent sentences 
and found it to be independently related to writing. However, there are several dif- 
ferences between Limpo and Alves’s study and the present study: (a) the former 
included older students in Grades 4 to 9, whereas the present study examined stu- 
dents in Grades 1 and 3; (b) the monitoring task in the former study was adminis- 
tered in the context of reading (students read inconsistent texts and corrected them 
in writing), whereas the monitoring task in the present study was in an oral language 
context; and (c) the former study did not include other higher order skills in the 
Statistical models, whereas the present study did. Given these differences, reasons 
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for the discrepant findings for the role of monitoring in writing are unclear. One pos- 
sibility is that perspective taking and monitoring may play unique roles beyond the 
beginning phase of writing development examined in the present study. For instance, 
Bereiter and Scardamalia (1987) found that on average, students at a more advanced 
writing phase (e.g., in Grade 7) use the “knowledge transforming” strategy where 
they adjust the content and the form of the text according to their communicative 
goal. In contrast, the primary writing strategy for beginning writers is “knowledge 
telling” where the writer’s focus is to encode what they know (their knowledge) in 
print, without attention to the content and form for a specific communicative goal. 
Perhaps, higher order cognitive skills such as perspective taking and monitoring 
play more prominent roles for the knowledge transforming strategy. Future studies 
with children in different developmental phases can shed light on this speculation. 


Limitations, future directions, and implications 


The following limitations should be considered when interpreting the present find- 
ings. First, the sample in the present study came from a single school, primarily 
serving children from middle-class and low-middle-class backgrounds. A future rep- 
lication with a more diverse sample is warranted. Second, the majority of constructs 
were measured using single tasks due to time and resource constraints. Therefore, in 
future studies, it will be ideal to measure each construct with multiple tasks to mini- 
mize measurement error. Also it will be ideal to include other component skills of 
writing. Although the component skills in the present study were relatively compre- 
hensive, previous studies have reported additional contributors such as background 
knowledge, including both content knowledge and genre knowledge (Olinghouse 
& Graham, 2009; Olinghouse et al., 2015); discourse oral language (Berninger & 
Abbott, 2010; Kim et al., 2015a; Kim & Schatschneider, 2017); and motivation/ 
affect factors (e.g., Graham et al., 2007). Finally, given the correlational nature of 
the study, causal conclusions are limited. Therefore, future studies are warranted to 
investigate whether instruction on the included component skills causally improves 
writing. 

The present study adds to growing evidence about the direct and indirect con- 
tributions of component skills to writing, using longitudinal data from Korean- 
speaking beginning writers, and indicates the importance of specifying and examin- 
ing structural relations among component skills. Future efforts are certainly needed 
to replicate and extend the present study with children in different (e.g., more 
advanced) stages of writing development and in different languages. 
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